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(54) Error concealment method and apparatus of audio signals 



(57) An apparatus for concealing a frame or multiple 
of frames where errors have occurred in a digital audio 
signal which is subband coded and transform coded in 
units of an error-correctible frame is described. The error 
concealment apparatus includes an error detector (10) 
for receiving frequency coefficients representing the 
encoded digital audio signal and detecting whether an - 
error has occurred for each frame, a decoder (1 00) for 
decoding the frequency coefficients by respective sub- 
bands forming a frequency domain of the whole audio 
signal with respect to the input frequency coefficients, a 
buffer (70) for storing the frequency coefficients decoded 
by said decoder (100), a frequency coefficient recon- 
struction portion (60) for reconstructing the frequency 

FIG. 



coefficients of a frame or multiple of frames where errors 
have occurred using predetermined weight values and 
frequency coeff icient(s) of subband adjacent to the error 
frame(s) among the frequency coefficients belonging to 
a frame which is stored in the buffer (70) and is adjacent 
to the error frame(s), and updating the frequency coeffi- 
cients of the error frame(s), and storing the frequency 
coefficients in the buffer (70), in response to the error 
detection result from error detector (1 0) and a synthesis 
filter bank (80) for receiving the frequency coefficients 
stored in the buffer (70) and converting the frequency 
coefficients into an audio signal of a time domain, in the 
same sequence as a decoding sequence. 
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(0 updating the frequency coefficients of the error framefs) stored in step (d) with the frequency coefficients recon- 
structed in step (e); and 

(g) converting the frequency coefficients resulting from step (f) into an audio signal of a time domain, in the same 
sequence as that decoding in step (c). 

Said step (e) may use frequency coefficients subbands which exist in the very previous frame of the error-generated 
frame(s) and is adjacent to the error-generated frame(s) ( to reconstruct the frequency coefficients of subbands of the 
error-generated frame(s). Said frequency coefficients may belong to the last segment of frame which is immediately 
preceding the error-generated frame(s). Said step (e) may calculate frequency coefficients corresponding to subbands 
of the error -generated frame(s), by multiplying the frequency coefficient adjacent to the error-generated f rame(s) which 
belongs to the very previous frame for each subband, by a predetermined weight value. Said predetermined weight 
values may be less than or equal to one. 

Alternatively, said step (e) may use frequency coefficients for subband(s) which exist in the very previous frame and 
the very succeeding frame of the error-generated frame(s) and is adjacent to the error-generated frame(s), to reconstruct 
the frequency coefficients for each subband of the error-generated frame(s). Said frequency coefficients may respectively 
belong to the last segment of the frame which is immediately preceding the error-generated frame(s) and the first segment 
of the frame succeeding the error-generated frame(s). Said step (e) may calculate frequency coefficients corresponding 
to subbands of the terror-generated frame(s), by multiplying the frequency coefficient adjacent to the error-generated 
frame(s) which belongs to the very previous frame for each subband, by a first weight value, multiplying the frequency 
coefficient adjacent to the error-generated frame(s) which belongs to the very succeeding frame for each subband, by 
a second weight value, and adding the two multiplication results. Said first and second weight values may be less than 
or equal to one. 

Preferably, said step (e) replaces said predetermined weight values for the audio muting by a value of zero, when 
the number of the succeeding frames where errors have occurred is larger than or equal to a predetermined number. 

According to a third aspect of the invention, there is provided a method for concealing a frame where an error has 
occurred in a digital audio signal which is subband coded and transform coded in units of an error-correctible frame, the 
error concealment method comprising the steps of: 

(a) receiving frequency coefficients representing the encoded digital audio signal; 

(b) detecting whether an error has occurred for each frame with respect to the input frequency coefficients; 

(c) decoding the frequency coefficients by respective subbands forming a frequency domain of the whole audio 
signal with respect to the input frequency coefficients; 

(d) storing the frequency coefficients decoded in step (c); 

(e) reconstructing the frequency coefficients of a frame where errors have occurred using predetermined weight 
values and frequency coefficients of frame or multiple of frames adjacent to the frame where the error has occurred 
in response to the error detection result in step (b); 

(f) replacing the frequency coefficients of the frame where the error has occurred by the frequency coefficients 
reconstructed in step (e); and 

(g) converting the frequency coefficients resulting from step (f) into an audio signal of a time domain, in the same 
sequence as that decoding in step (c). 

For a better understanding of the invention, and to show how embodiments of the same may be carried into effect, 
reference will now be made, by way of example, to the accompanying diagrammatic drawings, in which: 

Figure 1 is a schematic block diagram of a conventional digital audio signal encoding/decoding apparatus using a 
subband coding method; 

Figure 2 is a graphical view for explaining a digital audio signal; 

Figure 3 is a block diagram showing a conventional error concealment apparatus for a digital audio signal; 
Figure 4A-4C are waveform diagrams for explaining error concealment in the figure 3 apparatus; 
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Figure 5 is a block diagram showing an error concealment apparatus of a digital audio signal according to a preferred 
embodiment of the present invention; 

Figures 6A and 6B are conceptual diagrams for explaining a signal processing of a frequency coefficient recon- 
s struction portion according to the error concealment method provided in embodiments of the present invention; 

Figure 7 is a graphical view showing one example of a weight value (ai) by which a frequency coefficient is multiplied ; 
and 

w Figures 8A and 8B are conceptual diagrams for explaining a signal processing of a frequency coefficient recon- 
struction portion according to another error concealment method provided in embodiments of the present invention. 

Preferred embodiments of the present invention will be described below in more detail with reference to the accom- 
panying drawings figures 5 through 8B. 

75 The figure 5 apparatus reconstructs an audio signal compressed by the block such as encoder 1 in figure 1 for a 
digital audio signal. An error detector 10 detects whether an error has occurred for each frame of the input compressed 
audio signal, and generates an error frame indication signal representing that a frame can not be reconstructed due to 
an error. A decoder 100 decodes the compressed audio signal in a frequency domain. With respect to the audio signal 
compressed by encoder 1 of figure 1, the signal input to decoder 100 becomes frequency coefficients of respective 

20 subbands. In this case, decoder 1 00 generates inversely quantized frequency coefficients. The output signal of decoder 
100 is supplied to a buffer portion 70. Buffer portion 70 stores the frequency coefficients. A capacity of storing the data 
in buffer portion 70 is determined by which method of figure 5 apparatus is designed among error concealment methods 
explained with reference to figures 6A, 6B, 8A and 8B. Frequency coefficient reconstruction portion 60 reads out a signal 
which is stored in buffer portion 70 according to the error frame indication signal from error detector 10, and reconstructs 

25 the frequency coefficients of the frame where an error has occurred, according to a method to be described later. As a 
result, the frequency coefficients of the error-generated frame are reconstructed by frequency coefficient reconstruction 
portion 60. The reconstructed frequency coefficients are applied to buffer portion 70. The frequency coefficients of the 
error-generated frame which is decoded by decoder 100 in buffer portion 70 are replaced by corresponding frequency 
coefficients reconstructed by frequency coefficient reconstruction portion 60. Buffer portion 70 outputs the stored fre- 

30 quency coefficients in sequence matching a frame sequence to synthesis filter bank 80. Synthesis filter bank 80 multiplies 
the frequency coefficients of each frame supplied from buffer portion 70 by a windowing function, and transforms the 
resultant signal into a signal in the time domain. A digital-to-analog converter (DAC) 90 converts the signal applied from 
synthesis filter bank 80 into an analog signal. Therefore, the output signal from DAC 90 becomes a reproduced audio 

- ; signal in which the generated error is concealed: 

35 An operation of frequency coefficient reconstruction portion according to the exemplary methods proposed will be 
described below with reference to figures 6A and 6B. The error concealment method shown in figures 6A and 6B recon- 
structs the frequency coefficients of each segment in a frame where an error has occurred, using a frequency coefficient 
of the last segment of a previous frame. With respect to the subband coded audio signal, frequency coefficient recon- 
struction portion 60 reconstructs the frequency coefficients of the error-generated frame by the respective subbands. 

40 Figure 6A shows a case where one frame F 2 is not decoded due to an error. In this case, a value of the frequency 
coefficient of a first segment Si in frame F 2 becomes a value obtained by multiplying the frequency coefficient of the M- 
th segment S m being the last segment in frame Fi by weight value A coefficient of second segment S 2 is obtained 
by multiplying a coefficient of first segment Si by weight value a 2 . The following segments S3-S m are processed in the 
same manner as the above. Thus, the frequency coefficients of the whole segments SrS m belonging to frame F 2 where 

45 an error has occurred are reconstructed. Here, weight values (cti,a 2 a^,) are positive integers which are generally 

less than or equal to one and can be determined by a user. For example, if a 1 =a 2l ...,a m =a<1.0 , the frequency coeffi- 
cients of respective segments SrS m within frame F 2 are obtained by the following expressions. 

Coefficient (S v F 2 ) <- ax(S m , F.,) 

50 

Coefficient (S 2 , F 2 ) <- a^S^F^ 

Coefficient (S m , F 2 ) <- a^S^F^ 

55 Here, coefficient (Sj, Fj) represents a frequency coefficient belonging to the j-th segment of the i-th frame. At this 

time, since weight value a is smaller than one, the later the segment is located in one frame, the more sharply the 
frequency coefficient value is lowered. Such an example is shown in figure 7. 

As shown in figure 6B, when succeeding errors occur in several contiguous frames EFi, EF 2 EF n , the frequency 

coefficient of the last segment in frame Fi where an error does not occur, is used to reconstruct the frequency coefficients 
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of all frames EF 1t EF 2 EF n which are located succeedingly. To reconstruct the frequency coefficients of frames EF 1( 

EF n , a method similar to that explained with reference to figure 6A is applied. As a result, the frequency coefficient 

value of the m-th segment S m in the last frame EF n becomes a value obtained by.multiplying the previous weight values 
in all the error-generated frames. It is preferable in this case that the different weight values can be used in the respective 
5 error-generated frames EF 1( EF 2 ,...EF n . For example, the following expressions can be given. 

EF 1 «- « i=0.9. a 2 =....a m =1 
EF 2 4- a 1= 0.8, a 2 =.„.a m =1 

10 

EF 3 «- a n =0.6, a 2 =....a m =1 
EF (n-l)<" «1=01. a 2 =....a m =1 
15 EF n ^ ai =a 2 =....a m =0 

When the weight values are assigned in this way, the frequency coefficient of first segment S-i in first error-gen- 
erated frame EF^ shown in figure 6B is obtained by multiplying the coefficient value of m-th segment S m in previous 
frame by weight value ct-i^O.9). Likewise, the frequency coefficient values of second segment S 2 in first error-gen- 
20 erated frame EF-i is obtained by multiplying the first coefficient values by weight value a 2 . Thus, up to the (n-1 )-th error- 
generated frame EFrEF^j, a reproduced signal is made using a reconstructed frequency coefficient of the previous 
frame. However, since the weight values of the n-th error-generated frame are all zeros, this interval becomes an audio 
erasure state. That is, if the weight value is properly adjusted in this manner, an audio muting operation can be performed 
from any frame. 

25 The above-described method reconstructs the error using the last segment in the previous frame prior to error 
occurrence, for more convenient explanation. It is however possible to use a coefficient of a different segment which is 
located near the last segment of the previous frame or future frame. 

Figures 8A and 8B are views for explaining a further error concealment method modifying the error concealment 
method explained with reference to figures 6A and 6B. The error concealment method proposed in connection with 

30 Figures 8A and 8B calculates the frequency coefficients of the frame where the error has occurred, through an interpo- 
lation operation using a frequency coefficient of the previous frame with respect to the error-generated frame and the 
frequency coefficient of the following frame with respect to the error-generated frame. The method for calculating the 
frequency coefficient values of error-generated frame F 2 will be described below. In case of figure 8A, the frequency of 
the first segment S.i in frame F 2 is obtained by adding.a value of axoefficient valuejat JPj:1fcsegmentS m ln first frame. 

35 Fi multiplied by weight value Pi to a value of a coefficient value of first segment Si in third frame F 3 multiplied by weight 
value (1 -p-i). This can be represented as follows, in the general form with respect to all segments belonging to frame F 3 . 

Coefficients F 2 ) <- p,, x Coefficients m , F^ + O-p^ x Coefficients 1( F 3 ) 

40 Figure 8B shows an example where the figure 8A method is adapted in the case where the errors have occurred 

in the several contiguous frames. Since implementation of the figure 8B method will be apparent to those having skill in 
the art having read the foregoing description and studied figure 8B, the detailed description will be omitted. The weight 
values ai and Pi referred to in connection with figures 6 A, 6B, 8A and 8B can be obtained by a calculation method and 
can be used in the form of a look-up table. 

45 As described above, the error concealment method and apparatus according to embodiments of the present inven- 
tion reconstructs the frequency coefficients of the error-generated frame using the frequency coefficient of the contiguous 
frame, thereby minimizing an influence on the succeeding frames due to the error-generated frame. 

While only certain embodiments of the invention have been specifically described herein, it will be apparent that 
numerous modifications may be made thereto without departing from the scope of the invention. 

so The reader's attention is directed to all papers and documents which are filed concurrently with or previous to this 
specification in connection with this application and which are open to public inspection with this specification, and the 
contents of all such papers and documents are incorporated herein by reference. 

All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and/or 
all of the steps of any method or process so disclosed, may be combined in any combination, except combinations where 

55 at least some of such features and/or steps are mutually exclusive. 

Each feature disclosed in this specification (including any accompanying claims, abstract and drawings), may be 
replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise. 
Thus, unless expressly stated otherwise, each feature disclosed is one example only of a generic series of equivalent 
or similar features. 
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The invention is not restricted to the details of the foregoing embodiment(s). The invention extends to any novel 
one, or any novel combination, of the features disclosed in this specification (including any accompanying claims, abstract 
and drawings), or to any novel one, or any novel combination, of the steps of any method or process so disclosed. 

5 Claims 

1 . An apparatus for concealing a frame or multiple of frames where errors have occurred in a digital audio signal which 
are subband coded and transform coded in units of an error-correctible frame, said error concealment apparatus 
comprising: 

10 error detection means (1 0) for receiving frequency coefficients representing the encoded digital audio signal 

and detecting whether an error has occurred for each frame; 

decoding means (100) for decoding the frequency coefficients by respective subbands forming a frequency 
domain of the whole audio signal with respect to the input frequency coefficients; 

buffer means (70) for storing the frequency coefficients decoded by said decoding means (100); 
is frequency coefficient reconstruction means (60) for reconstructing the frequency coefficients of a frame or 

multiple of frames where errors have occurred using predetermined weight values and frequency coefficients of 
subband(s) adjacent to the error frame(s) among the frequency coefficients belonging to a frame which is stored in 
said buffer means and is adjacent to the error frame(s), updating the frequency coefficients of the error frame(s) 
and storing the frequency coefficients in said buffer means (70), in response to the error detection result from error 
20 detection means (10); and 

a synthesis filter bank (80) for receiving the frequency coefficients stored in said buffer means (70) and con- 
verting the frequency coefficients into an audio signal of a time domain, in the same sequence as a decoding 
sequence. 

25 2. An apparatus according to claim 1 , wherein said frequency coefficient reconstructions means (60) uses frequency 
coefficients of subbands which exist in the very previous frame of the error-generated frame(s) and is adjacent to 
the error-generated frame(s), to reconstruct the frequency coefficients of subbands of the error-generated f rame(s). 

3. An apparatus according to claim 2, wherein said frequency coefficients to be used for reconstruction belong to the 
36 last segment of the frame which is immediatelypreceding the error-generated frame(s)7 " 

4. An apparatus according to claim 2 or 3, wherein said frequency coefficient reconstruction means (60) calculates 
frequency coefficients corresponding to subbands of the error-generated frame(s), by multiplying the frequency 
coefficient adjacent tdtheerror^generated frame(s) which belongs to the very previous frame for each subband, by 

35 a predetermined weight value. 

5. An apparatus according to claim 4, wherein said predetermined weight values are less than or equal to one. 

6. An apparatus according to claim 1 , wherein said frequency coefficient reconstruction means uses frequency coef- 
40 f icients which exist in the very previous frame and the very succeeding frame of the error-generated frame(s) and 

is adjacent to the error-generated frame(s), to reconstruct the frequency coefficients for subband(s) of the error- 
generated frame(s). 

7. An apparatus according to claim 6, wherein said frequency coefficients to be used for reconstruction respectively 
45 belong to the last segment of the frame which is immediately preceding the error-generated frame(s) and the first 

segment of the frame immediately succeeding the error-generated frame(s). 

8. An apparatus according to claim 6 or 7, wherein said frequency coefficient reconstruction means (60) calculates 
frequency coefficients corresponding to subbands of the error-generated frame(s), by multiplying the frequency 

so coefficient adjacent to the error-generated frame(s) which belongs to the very previous frame for each subband, by 
a first weight value, multiplying the frequency coefficient adjacent to the error-generated frame(s) which belongs to 
the very succeeding frame for each subband, by a second weight value, and adding the two multiplication results. 

9. An apparatus according to claim 8, wherein said first and second weight values are less than or equal to one. 

55 

10. A method for concealing a frame or multiple of frames where errors have occurred in a digital audio signal which is 
subband coded and transform coded in units of an error-correctible frame, said error concealment method compris- 
ing the steps of: 
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(a) receiving frequency coefficients representing the encoded digital audio signal; 

(b) detecting whether an error has occurred for each frame with respect to the input frequency coefficients; 

(c) decoding the frequency coefficients by respective subbands forming a frequency domain of the whole audio 
signal with respect to the input frequency coefficients; 

(d) storing the frequency coefficients decoded in step (c); 

(e) reconstructing the frequency coefficients of a frame or multiple of frames where errors have occurred using 
predetermined weight values and frequency coefficients of subbands adjacent to the error frame(s) among the 
frequency coefficients belonging to a frame adjacent to the error frame(s), in response to the error detection 
result in step (b); 

(f) updating the frequency coefficients of the error frame(s) stored in the step (d) with the frequency coefficients 
reconstructed in step (e); and 

(g) converting the frequency coefficients resulting from step (f) into an audio signal of a time domain, in the 
same sequence as that decoding in step (c). 

1 1 . A method according to claim 1 0, wherein said step (e) uses frequency coefficients subbands which exist in the very 
previous frame of the error-generated frame(s) and is adjacent to the error-generated frame(s) p to reconstruct the 
frequency coefficients of subbands of the error-generated f rame(s). 

12. A method according to claim 1 1 , wherein said frequency coefficients belong to the last segment of frame which is 
immediately preceding the error-generated frame(s). 

13. A method according to claim 11 or 12, wherein said step (e) calculates frequency coefficients corresponding to 
subbands of the error-generated frame(s), by multiplying the frequency coefficient adjacent to the error-generated 
f rame(s) which belongs to the very previous frame for each subband, by a predetermined weight value. 

14. A method according to claim 13. wherein said predetermined weight values are less than or equal to one. 

15. A method according to claim 10, wherein said step (e) uses frequency coefficients ^ the 
very previous frame and the very succeeding frame of the error-generated frame(s) and is adjacent to the error- 
generated frame(s), to reconstruct the frequency coefficients for each subband of the error-generated frame(s). 

16. A method according to daim 15, wherein said frequency coefficients respectively belong to the last segment of the 
frame which is immediately preceding the error-generated frame(s) and the first segment of the frame succeeding 
the error-generated frame(s). 

1 7. A method according to claim 1 5, wherein said step (e) calculates frequency coefficients corresponding to subbands 
of the error-generated frame(s), by multiplying the frequency coefficient adjacent to the error-generated frame(s) 
which belongs to the very previous frame for each subband, by a first weight value, multiplying the frequency coef- 
ficient adjacent to the error-generated frame(s) which belongs to the very succeeding frame for each subband, by 
a second weight value, and adding the two multiplication results. 

18. A method according to claim 17, wherein said first and second weight values are less than or equal to one. 

19. A method according to claim 10, wherein said step (e) replaces said predetermined weight values for the audio 
muting by a value of zero, when the number of the succeeding frames where errors have occurred is larger than or 
equal to a predetermined number. 
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FIG. 1 (PRIOR ART) 
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FIG. 4 A ( PRIOR ART) 
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for decoding the frequency coefficients by respective 
subbands forming a frequency domain of the whole 
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coefficient reconstruction portion (60) for reconstructing 
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in the buffer (70) and is adjacent to the error frame(s), 
and updating the frequency coefficients of the error 
frame(s), and storing the frequency coefficients in the 
buffer (70), in response to the error detection result from 
error detector (10) and a synthesis filter bank (80) for 
receiving the frequency coefficients stored in the buffer 
(70) and converting the frequency coefficients into an 
audio signal of a time domain, in the same sequence as 
a decoding sequence. 
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